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ABSTRACT 

The thesis of this parser is *** J at all children, 
excepting those of certifiable handic-n, are —rucahle, and the 
behavior of the school is critical in ^teraE^^ing the quality of tha^ 
educaticn. Concentrating on several iir«*rc*"*v schools in Detroit, 
this paper discusses the distinguishing '^^racrrerisrric— of schools 
that are instructionally effective for wn-*r children, '^e emphasis 
on alternative approaches to desegregati ■ arr could successful 
in improving the quality of instruction 3fft " airfl* *o d c segregated 
pupils. Other studies don a on inst itutios*! *fj£*c^i**^ s axe 
referred to and analyzed in terms of their :StfP*ror*hs a»r- weaknesses- 
The performance levels of students in differ:—;! "•' ^a'l? Hi verbal 
achievement tests are used as th€ criteria f ; yzi^^ 

effectiveness of different schoals. TaJcen irzn .±z±Ae\ 4 r*n are rac 
and home background of the studert sample Tr^mx ^ : nd3-*n<?s conc<?rn:^ 
the influence of teacher attitufes and citerr-r*-* 1 - v ics, £C*ool 
characteristics, curriculum/ aivt school ^rfffl^TBC* "e ^ns°sented, 
(Author/EB) 
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SEARCH FOR EFFECTIVE SCHOOLS z 

CT> 

THE IDENTIFICA TION i+JTD ANAL YSIS OF SCHOOLS 
rnv 

O THAT ARE IKSXSUCTIOSAIXY EFFECTIVE FCT ?O0R CHILDREN 1 



LlJ By Ronald R, Ed iaaants and .Tohn R. Freieriksen 



Attaining educational equity in our society requires chat-jail 

children have access to Insrxuc txcnally effective schools* Our 

society has no^ yet attained educational equity and our failure 

cakes two principal £orais* Many schools segregate children by 

race and then deny b w ack pupils equitable distribution of 

educational resource^ Mirnt schools implicitly classify children 

mt the basis of facsi;. background, and then express pxeferencr 

for niddle-class chcl^irren and d±sda±n for the poor. Thus, for 

Chose of us who seek equity, the most critical policy natters 

in public education srre court* -ordered desegregation and effective 

instruction for poor chilerssi* The authors' unstintir.e opposition 

to segregation comoels there to continue to suoport court-ordered 
busing as a means of achieving desegregation. Despite that, ve 

recognize the tactical limitations of busing when educational equity 

^* is the obl^-tivc. Educational equity requires the absence of 

O 



for all. 
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discriminatory pupil placc^ssr-t and effective classroom Instruction 



There is no need here to elaborate the divisive and sometimes 
debilitating impact of court-ordered bussing on the social fabric 
of many important Americas* caries,. Boston and Louisville are but 
the most visible of "a haLf-dcr^n rajor metropolitan settings 
recently torn by the intense enotions and severe dislocation that 
accompany court-ordered desegregation. Opinion polls, impression- 
istic educational literature, and academic analyses make clear 
that the growing loss o5 public confidence in the equity of court- 
ordered busing is partly a function of our schools 1 seeming 
inability to effectively educate desegreeated children who are 

poor. Moreover, there is a body of recent social science literature 
(Coleman* Jeacks, e£ al) 

which can b^ said to virtually repudiate urban school reform as an 
instrument ccf social equity- Thus those of us who seek dramatic 
improvement ±a the qualiry of schooling available to the your do so 
in a climate ~f public frustration and educator dispirit* The 
experiences of the most recently desegregated cities are not likely 
to relieve public frustration or raise educator spirits. 

These remarks are not r.eant to offer a scintilla of support 
to the racisnr that is principal cause of most city council, school 
committee, end board of education opposition to desegregation. 
These remarks are meant to acknowledge the appropriateness of seeking 
alternative approaches to desegregation that will be more successful 
in improving the quality of instruction available to desegregated 
pupils. Desegregation in particular and urban school reform in 
general would be sreatlv advanced were ve to articulate reliable 
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ceans for icproving the quality of teaching ia schools that serve 
the urban poor. 

Public perspective on these matrers nust flounder till at least 
one of two conditions come to pass. An altered political climate 
nay precipitate a renewed quest for greater social justice, in which 
case we will not have to wait for social science initiative before 
renewing efforts to make effective schooling independent of pupil 
family income and social class. What is more likely is that social 
science research will produce findings that show that instructional 
effectiveness is a function of certain explicit institutional 
circunstances that are accessible to any group of educational 
decisionmakers determined to create and maintain such circumstances* 

The annual average per pupil expenditure is rising with 
no conconiitaat rise in public acceptance of reported levels of 
pupil performance. Most public policymakers and educational 
decisionmakers would therefore eagerly pursue evidence of practical 
means by which pupil performance might be improved 9 particularly 
for those least well-served by existing educational arrangements . 

We are surrounded and daily besieged by irresistable 

evidence of the social paiholocy that characterizes much of the 
life of our major institutions. Schools are no exception. Our 
national need to know of "thirds chat work" ha-? never been creator. 
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It is*« pt%asely this point in the public policy fr^y thar 
this discusr Aefcs to enter. This discussion will dasssceibe the 
authors' ei'&f: : t*> identify and analyze city schools tk#t are 
instrucefcwuaiy effective for poor and/or ainoritrr children. «e 
are pleascA ta *' 'te rhat we have already developed unusually 
prnmisinr ^vicbenc* o£ the thesis we seek to demonstrate far the 
research Aestr^rt on.. Our thesis is that all. xhilcteeE, .-mm' n «5 

only thos" terclf icable handicap, are eminently "dacab]*.. a* th* 
behavior Jte sxaool is critical in determining rvmtqxial±*T af« 
education 

The S«.arc tor Effective Schools" project began by MMwerir- 
the question-" "Are there schools that are instruc3&bnal2^ effecri** 
for poor oi.lltf *»<*?" In Seotenber of 1974 Lezotte, Sgnoiwta, and 
Ratner de#«ia»< their analysis of pupil performance; in tlHne Cwenr-. 
elemental sdrfc^ls that make up Detroit's Model CSnfLes SfelfeSoxfar^ 
(See L fc Edmonds, and Ratner' s "Remedy for St5=id1 Failure to 

EquitaV l>wr Basic School Skills"). All of the schawls are 

located wv^f-city Detroit and serve a predosSq\aFtly ^ ' 

minorit? *v»U Population. Reading and nath scosS5 were analyzed 
from D«. .t's Spring 1973 use of the Stanford -Ar* evemect Test and 
the Ic . ?st of Basic Skills. Of the 10,000 anvils in the twenty 
schoc • the Model Cities' Neighborhood, 2500 randomly 




eaapled, With minor variation, the sample ^ included eight puplia 
per classroom in each of the twenty 3chools. The mean math and 
reading scores for the twenty school were compared with citywide 
norms. We were primarily iatereao^r in whether the data wo^M reveal 
strong differences in the quality * teaching among the twenty 
fichcrt>ls. We could thus rely on cityvide performance norms Ifespite 
the limitations of local standards 3 a measure of school elective- 
nts . An effective school among the twenty was defined as aeing at or 
>in?ve the city average grade equivalent la math and r£*fcdiis&« An 
ineffective school was defined as below the city avesaif* Isfeing 
th«pe criteria, eight of the twenty schools were jtrifl^ , ''Teetive in 
teaching math. Nine were judged effective in teachbogg re ding and 
five were judged effective in teaching both math anc 'reaAing- 

Having tenratively established that instructio— 1 1y effective 
city schools can b located, we turned to the problem of establishing 
the relationship between ptipil fassily background ap4»J> n1^^fri g 
effectiveness. Two schools among tiie twenty, DuffissLd and Bunche, 
were found that were matched on the basis of elevezs^sodal indicators* 
Buffield pupils averaged nearly foiar months above Ctie city average 
in reading and math. Burrche pupils averaged nearly three months 
below the city reading average and 1.5 months below the city math 
average. The shared social class characteristics of the pupil 
populations in both schools are shown in Table 1. 



TABLE 1 



A.mMPARISO!! OF THE DUFF I ELD AST) 3U7JCKE ELEMENTARY SCHOOLS 

PUPIL POPULATIONS 
ON TET: BASIS OF 1970 CENSUS DATA 
AND 3973 SCHOOL CHARACTERISTICS 



Pupils from low economic status 
Minority group pupils 
Minority group starr members 
Average class size 
Average pupil attendance 
Pupil mobility 

Pupils over-age in grades 3-6 
Average teacher experience 
Number of paraprof essionals 
Federal Compensatory Education 

Title I school eligibility 
State Compensatory Education 

Chapter 3 pupil eligibility 



Duffield 



Bunch e 



192 

972 

72Z 

22 

912 

302 

222 

14 yrs . 
3 

Eligible 



20Z 

99.92 

762 

21 

902 

422 

512 

9 years 

3 

Eligible 



502 



572 



The similarity in the characteristics of the two pupil 
populations permits us to infer the inoortance of school behavior 
in Baking pupil performance independent of faaily background. 
The overriding point here is that, in and of itself, pupil fantfGfcy 
background neither causes nor precludes elementary school instxrucrlsmal 
effectiveness . 

Despite our satisfaction with our findings, 

ve recognized the limitations of the 
Detroit Model Cities'Neighborhood analysis. Our evaluation of school 
success with poor children had depended on evaluating schools with 
relatively homogeneous pupil populations. The numbers of schools 
were too few to justify fira conclusions. Finally, the achievenent 
tests were normative, as was the basis for determining building 
effectiveness among the twenty schools. Nonetheless, the Model 
Cities 1 Neighborhood analysis had served our purposes veil by ranking 
twenty inner city schools on the basis of pupil performance and 
deacxi&isig certain of the characteristics of two of those sefaools. 

The second phase of the project was a reanalyris of the 1966 
Fv ^1 Educational Opportunity Survey (EEOS) data (see John Frederiksen's 
"School Effectiveness and Equality of Educational Oppcrtunity") . 
Our purpose was to answer a number of research questions that 
required a data base both larper and richer than had been available 
to us in the Model Cities 1 Neighborhood analysis. We retained our 
interest in identifying instructional!? effective schools for the 
poor, but in addition ve %\mted to studv the effects of schools on 
children havins different so*:i.iL backgrounds . Such an incuirv would 
permit us to evaluate school contributions to educational outcomes 
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independcnC of our ability Co match schools on the baris of the 
socioeconomic characteristics of their pupils. The final and 
most important purpose of our reanalysis was a critical examination 
of earlier studies of school effectiveness that have concluded 
that pupil performance is principally a function of pupil 
background characteristics. 

Studies of School Effectiveness 

It was a belief in the importance of education as a means of 
social mobility, as veil as concerns regarding freedom of access to 
quality education, that led Congress ia 1965 to order the 
Commissioner of Education to undertake an assessment of the equality 
of educational opportunity then prevailing among the public schools 
of the United States (Coleman et al., 1966). That assessment is 
popularly known ?.3 "The Coleman Report," 

The report concluded that when ouoil social-class and home 
background were taken into account, little variation in school 
achievement was left to be accounted for by differences in school 
programs and facilities. About seven years later, following 
extensive reanalyses of theEZOS, Mosteller and Moynihan (1972) 
concluded : 

Given that schools h?,ve reached their present levels of quality, 
the observed variation in schools was reoorted bv EEOR (Equality 
of Educational Conor tunitv ?,cr,orc) to have little effect unon 
school achievement. This actually means a large joint effect 
owing to both schools and home background (including region, 
degree of urbanization, Tocioeconcmic status, and ethnic group), 
little that is unique to schools or homes* (p. 21) 

Thus, despite the nethodoloalc^l and statistical concerns which 
motivated numerous reanalyzes of the ir.OS (e.a-, Armour, 1972; 



9 



-8- 

Cain & Watts, 1970; Uanushek & Kain, 1972; Jencks, 1972; Smith, 
1972), Coleman's summary conclusion stood: /school characteristics 
are unrelated to student achievement, once factors of social 
background have been controlled. 

We vere prompted to do a reanalysis of the EEOS partly by 
our belief that too little is understood about what it means to 
statistically "control" the social background of pupils. Most 
analysts of the EEOS data divide the total variation in pupils' 
school achievement into two orthogonal parts: variation between , 
schools, measured by the deviations of school means from Che 
overall grand mean, and variation within schools, based upon the 
deviations of individual pupils from the mean achievement level for 
the school taken as a whole. Typical statements are that as much 
as 90Z of the total variation in verbal achievement lies within 
schools, leaving a maximum variation of only 10% attributable to 
differences between schools (c£. Hosteller & Moynihan, 1972) . If 
school effects are calculated on the basis of mean pupil achievement 
levels within a school, it is clear that these school means will in 
part be determined by the population of pupils enrolled in a 
particular school and, more specifically, by their home background 
and social class. Thus, in order to assess the contribution of 
school programs and characteristics to achievenent, data analvsts tiad 
to adjust the mean achievement scores for each school by an anount 
(a "school handicap', cf. Coleman, 1975) vhich is determined by the 
social class and family background of pupils within the school (cf. 
Coleman et al. t 1965: Jencks , 1972). This was accomplished by 
repressing mean achievement scores for schools on social background 
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variables, and taking the residual scores as a measure of school 
effectiveness adjusted for pupil social background • Thus, social 
class variables were the first variables entered into the regression 
analysis. Smith (1972) and others (Hanushek & Kain, 1972; Mayesks 
et al., 1972, 1973) have criticized this approach on the grounds that, 
due to covariation betveen school characteristics and social class 
variables, removal of the latter set of variables will at the same 
tine remove variance in mean school achievement which is also 
associated with school characteristics and programs. Mayeske et al. 
(1972, 1973) developed an alternative, and symmetric, analysis of 
school achievement which provides separate estimates of the 
proportion of school-to-school variation associated (1) uniquely 
with social class variables, (2) uniquely with school variables, 
and (3) jointly with social elass and school characteristics. Their 
conclusion is that little variation in mean schn*>I achievement is 
uniquely associated with either student social ; :* \^£r*^nd or school 
characteristics. For examole, in their sixth-gi^u:>. *vr*iysis 9 11% of 
the variation in achievement is uniques / related tc background, 5% 
is uniquely associated with school characteristics, and 712 is 
associated with the common or i ndistinguishable influence of school 
characteristics and student social background. Interestingly, when 
the school population was stratified according to averace socio- 
economic status (SES) of pupils in each school M the independent role 
olaved by the Student Body variables vas creator than that of school 
variables for hith SES schools. In cur.trasc, for lew ScS schools 
the school variables piaved a rrencer ir.ccr.cndcnt rele than the 
student body variables (Mayeske et al., 1972, p. 57)." 

V 

-A. 
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When variables related to social class are not controlled, 
variation in school achievement that is consnon to school and social 
class variables is included in the assessment of school effectiveness, 
leading to conclusions which are at variance with those of Coleman, 
et al. (1966). Shaycoft (1967), for example, has analysed growth 
in achievecent for high school seniors previously tested in the 
ninth grade. Growth rates differed for different schools, and 
discriminant functions revealed a variety of school and community 
characteristics which differentiate hieh from low-achieving schools • 
However, no attempt was made to distinguish M between effects of 
what the school does and effects of other environmental influences, 
such as family and community" (Shaycoft, 1967, ?• 7) 

One of the methods for controlling for the influence of family 
background is to ensure that the schools being compared have 
comparable or matched pupil populations. In addition to the 
analysis of Detroit Model Cities' Neighborhood Schools described 
earlier, there are two other studies that have used this technique. 
In the first study (Weber, 1971), four inner-city schools were 
located that had median third-grade reading scores at or above the 
national grade norm, and that also had few pupils classified as 
"nonreaders" in comparison with typical inner-city schools. The 
schools studied were all nonselective in admissions, located in the 
central areas of large cities, and attended predominantly by poor 
children. The four effective schools shared some characteristics 
which are not ordinarily orescnt i,i inner-city schools. These 
included: stronr administrative lo.t,!ership, hi^h expectations for 
pupils, an ord*rly acr.osohere , strong emphasis on feadincj, use of 
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phonics, individualized instruction, and the periodic evaluation 
of each pupil's progress. Thus, there is evidence that when 
investigators restrict their attention to a target group of poor 
children living in the inner city, effective schools can be located 
which do not differ in terns of pupil family background from other 
schools which are less effective. However, in this study a set of 
control schools was not locatedj thus comparisons were to a set of 
normative school characteristics thought typical of inner city 
schools. 

In the second study (State of New York, Office of Education 
Performance Review, March, 1974), two inner city schools serving 
disadvantaged children were selected on the basis of levels of 
reading achievement, one having high mean achievement and the other 
low mean achievement. The two schools were chosen so as to be 
matched on a variety of student background factors, including race 
and social class. Differences In pupil achievement in these two 
schools were attributed to factors judged to be under the school's 
control, among thea administrative policies and practices, plans 
for reading instruction, characteristics and attitudes of teachers, 
and other professional personnel. 

In what is probably the most coaprehensive review of evidence 
for school effectiveness, Averch et al. (1972) have at several 
points emphasized the possibility that the effects of schools on 
their students nay not be the sa;ze for all subgroups of students 
enrolled in the schools, and have hinted that the failure to take 
Into account differential effects of schools on ouoils bavin? 
different characteristics nay account for the inability of 
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educational researchers to identify effective school programs. 
They point out, for example, that students attending the same school 
nay receive substantially different amounts of the school's 
resources. In discussing teacher characteristics, they conclude that ■ 
teacher expectations are based in part on pupil social class member- 
ship (Rist, 1970), that teachers have been found to detsand less from 
children from whom they expect less (Brophy & Good, 1970), and that 
in the future, "studies of long-term trends in teacher effectiveness 
must designate which kinds of students the teacher is effective with, 
as well as how effective he is (?• 60). M Finally, they suggest 
that "a general failure to match student characteristics with specific- 
educational programs is a major reason for the lack of positive 
findings in educational research and for the consequent lack of 
success in defining factors that substantially affect educational 
outcomes (p. 77)." Ve suspect that what is needed in the assessment 
of school effectiveness is an approach which takes into account the- 
interactions between characteristics of pupils and characteristics 
of the schools they attend. 

The design of our reanalysis proceeded from the following 
premises, which differ from those of our predecessors and represent 
an attempt to relax past assumptions that may have obscured 
relationships between school characteristics and pupil performance- 
1. Schools arc not uniformly effective for all Pupils cho attend them. 
A school that is effective in teaching middle-clas3 children may not 
be effective in teaching poor children. This means that the 
institutional characteristics associated with effective teaching may 
varv as a function of the family background and social class of pupils 



u 



-13- 



vhose performance is evaluated. Therefore, the assumption of 
homogeneity of regression equations for subgroups of pupils varying 
in race and social background will be relaxed, in order to allow for 
possible interaction between a pupil f s fanily background and the 
school characteristics that are related to successful pupil 
performance. 

2m Pupil social class and family background have two aspects : 
they represent characteristics of the individual student , which 
influence his level of achievenent, and (in their distribution) 
they represent characteristics of the set of pupils attending a 
given school . These two aspects of social background must be 
separated in any statistical study of school effectiveness (cf . 
Hayeske et al., 1973). 

3. Conclusions about the existence of effective schools should 
be non-normative . Our interest, froa the standpoint of judging 
equality of educational opportunity, is not in the proportion of 
variance in the sample attributable to differences among school 
means, but rather in demonstrating the existence of some schools 
that are educationally more effective than others for particular 
groups of children. Since consistency is one of our criteria for 
Judging effectiveness, an effective school mist be shown to be 
consistently effective for two or nore independent grouos of pupils 
having comparable or nearly comparable social backgrounds. This 
criterion is logically equivalent to that used by Xlitg.nard and 
Hall (1973). 

4 . Cone lu slons ah o uC school e f f ect ivt-ness arc terr.ooreJ b v the- 
oerforoartcc measure er.?_loyod. Schools that have effective reading 
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progracia nay b-n ineffective in reaching other basic skills. Since 
our reanalysis wa3 based on a data file containing measures of 
verbal performance (Jencks, 1972), our results cannot be generalized 
at this stage to other measures of performance. It should be noted 
that we are relying on a measure that is usually considered a test 
of verbal aptitude , rather than a test of achievenent - Aptitude 
tests do not measure skills that are closely related to instructional 
programs employed in schools, and are considered relatively 
insensitive to differences among educational programs. This choice 
of a performance criterion is therefore conservative with regard to 
the effort to demonstrate the existence of instructionally effective 
schools. 

Tn addition to the premises above, the following assumptions of 
Coleman, et. al. f (1966) were adopted: 

5. School effectiveness (we add, for a given performance measure and 
for a designated target group of students) can be measured by the 
aver a ge performance of students in the schoo l. 

6. The familv/social background of an individual student and school 
response to that background must be taken into account in assessing 
school effectiveness, 



METHODS OF ANALYSIS 
Our procedure was to stratify the pupil population into a sk£ 
of criterion subgroups, as did Guthrie et al. (197L). Our 
classification of oupils v,as basec on their race and her:* background. 
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Separate analyses cf school effectiveness vcre then carried out 
for each subgroup, using the mean achievement scores for pupil 
subgroups within each school as measures of school effectiveness. 
By correlating these measures of effectiveness for all pupil 
subgroups, we could determine empirically if school effectiveness 
extends to all pupils, regardless of their social class, or if it - 
is limited to pupils of a single social group. We then examined 
the effects of peer social class on achievement when individual 
family background was held constant — by restricting consideration 
to one subgroup of pupils at a time. Finally , a description of 
certain characteristics cf more effective and less effective schools 
was attempted, on the basis of the questionnaire responses of 
teachers and school principals. In this analysis, examination 
included (1) the social class characteristics of the pupils within 
a school taken as a whole, (2) teacher attitudes and characteristics, 
and (3) school programs and characteristics, as revealed in the 
teacher's and principal's questionnaires. 

Subject Population 

The source of our data was an intermediate surtmary file used 
In earlier analyses of the EEOS (Jencks, 1972). The subject 
population included sixth grade pupils in northern elementary 
schools and tested in the EEOS (Coleman, et al.„ 1966). 

Measure of Pupil Performance 

The pupil performance r.easure was a standardized sixth Grade 
verbal achievement test creoared by Educational Testing Service and 
administered as pare cf the EEO : . 
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Identification of Puptl Subgroups 

Pupils within each school were stratified into subgroups based 
on their race (black or white) and their responses to a set of 
questions about hone items, which were included in the EEOS student 
questionaire. The^e nine home item questions are reproduced In 
Table 2. The home index scale is the number of itecs for which a ' 
given child checks "yes 11 . The scale tends to make fine distinctions 
among the very poor, lumping middle-class children together at the 
high end of the scale. This is the same home index scale that has 
been used to define "poor" children in other studies derived from 

the EEOS data (cf. Armour, 1972; Jencks, 1972; Saith, 1972). Four levels on 
the home index scale were distinguished: 0-4, 5-6, 7-8, and 9 home items. 
Statistical Analysis 

For each school, the mean verbal achievement score was calculated 
for each of eight subgroups of pupils that represent two races and 
four home-index levels. The schools were then ranked on the basis 
of the mean performance of the pupils in each subgroup, yielding 
eight separate rankings of the schools. From these rankings, two 
points were indentified: the 25th and 75th percentiles. Schools for 
which the mean achievement of pupils in a given subgroup was above 
the 75th percentile were considered effective for that subgroup, 
and schools for which the mean performance was below the 25th 
percentile were considered ineffective- Consistency in school 
effectiveness was then investigated by gaugins the extent to which the 
schools were classified as effective for a second independent sub.eroup 
of pupils. A statistical test of the independence of these two ^ 
classifications was then carried out. As an alternative procedure, 
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TA3LE 3 

Home I tens Scale Used in the EEOS 

Does your family have a television set? 

(A) Yes 

(B) Mo 

Does your family have a telephone? 

(A) Yes 

(B) No 

Does your family have a record player, hi-fi, or stereo^ 

(A) Yes 

(B) No 

Does your family have a refrigerator? 

(A) Yes 

(B) No 

Does your family have a dictionary? 

(A) Yes 

(B) Mo 

Does your family have an encyclopedia? 

(A) Yes 

(B) Ho 

Does your family have an automobile? 

(A) Yes 

(B) Mo 

Does your family have a vacuum cleaner? 

(A) 
(B) 

Does your famiilv ect a neuspaoor every dav? 

(A) Yes 
(10 --'o 
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correlations between the mean verbal achievement measures obtained 
for different subgroups of pupils within schools were calculated. 
These analyses were designed to reveal the degree of consistency in 
school effectiveness and the generality of these effects for 
"ferott classes of pupils. 

Use relationship between mean verbal performance of subgroups 
f pupils within a school and school social class variables., teacher 
variables, and other school characteristics vas investigated by 
( 1) comparing the means for each of these additional variables for 
effective and ineffective schools, and (2) by looking at correlations 
for each of these variable with mean verbal achievement . These 
analyses were supplemented in the first case, by discriminant 
function analyses, and in the second case, by multiple regression 
analyses. These investigations of the relation of school effectiveness 
to school and teacher characteristics were conducted separately for 
each of tire eight subclasses of pupils previously identified, a list 
of the school variables is given in Table 3, along with descriptive 
statistics for the Northeast sample of schools. 

RESULTS 

Preliminary analysis sought an swer s to the following questions. 
Question One ; Are there Schools Thar are Ins t rue t ionallv Effective? 

The nean levels of verbal performance for each of the eisht 
subgroups of pupils are gi**en in Tabic 4, alons with the standard 
deviations of distributions of school rrcans , the ranqes of school 
cieans > and the numbers of schools in our sample having ouoils in each 
category. Also given arc the r:ean, standard deviation, and rar.2e for 
the number of puortls within a school. Vote th.it the identification 
of n particular criterion rrroun of r*untt.ls to.?., hlac!: children 
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Verbal scores for Subnrouna of Students classified by Race 
and Number of How Items 
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with 0-4 hone items) involves not: only the selection of a particular 
subset of pupils within a given school, but also the selection of a 
particular subset of schools — namely, those which enroll the given 
class of children. For example, only 288 out of 312 schools in the 
sample (or 35%) enrolled students in the poorest black category, and 
718 or 88% of the schools enrolled white students having the entire 
set of 9 hone itens. The reader cast keep in mind that, when we are 
discussing different target grouos of pupils, we are implicitly 
basing our remarks on different (but overlapping) subsets of the. 
school sample. Descriptive statistics for each of these eight ever- 
lapping samples of schools are given in an earlier report 
(Frederiksen, 1975). 

There are substantial differences in mean verbal performance 
for black and white children, and for children from poor and middle- 
class home backgrounds. The differences in scores, for example, 
between black pupils having 9 hone items and those having only 0-4 . 
home items is 9.36 points, representing a 2.3 year difference in 
normative grade equivalents : 2 tha corresponding figure for white 
pupils is 11.39 or 2.8 years. These differences are much larger 
than those associated with race, which range from 4,36 (or 1.1 years), 
for the poorest category of children to 6.38 (or 1.5 years) for the 
most advantaged group of children- The variability in school nreans 
also appears to be larger in the case of poor children than it is 
for children from more advantazed hones. The nutriber of black and 
white pupils within a school who are in the poorest category (having 
0 to 4 home iter^) is smaller than for the other categories, and this 



nay explain why the sample means for these groups have greater 
variability than do those for the other groups of puDils. However, " 
what Is perhaps the most striking feature about these data Is the 
close similarity in the ranges of school means from one pupil subgroup 
to another. This suggests that a substantial number of schools are 
effectively teaching verbal skills to the poorest group of children, 
and conversely, that a substantial number of schools are failing to impart 
necessary verbal skills to their pupils, whatever their race or social 

background . 

A demonstration that the mean performance level of a school is 
high or low relative to the overall distribution of school means 
obtained for a given group of pupils is not sufficient by itself to 
establish the existence of an effective shcool. Additionally, 
information must be obtained about the reliability or consistency 
of these school differences. The question is, will an independent 
sample of pupils within the same school score as high (or low) in verbal 
achievement as the original group of pupils? In other words, given 
two opportunities to exhibit excellence, will a school turn out to 
be effective for both samples of students? 

This question was dealt with in two ways. First, correlation 
coefficients were calculated between the mean verbal scores obtained 
for subgroups of pupils classified by race and hone background: 
these intercorrelations are shown on the left side of Table 5. 
Second, for each subgroup of pupils, the schools were ranked 
according to the performance level of the relevant group of pupils, 
and the 75th percentile of t'.ie distribution was determined. Schools 
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having nean performance measures above the 75th percentile were then 
classified as effective for that group, and the others classified as 
moderately effective or ineffective. 3 Note that the cutting point 
(75th percentile) was determined separately for each criterion 
subgroup of pupils, so that the nean performance levels used in 
classifying schools for one group of pupils are not the same as those 
used in classifying schools for another group of pupils* Moreover, 
since the subgroups of pupils are not overlapping, these separate 
classifications of the schools in the sample are independent* A 
school classified as effective for one pupil group will not necessarily 
be classified as effective for another group. To investigate the 
degree of consistency in the effectiveness of schools for different 
subgroups of pupils, crosstabulations were obtained for schools 
classified as effective or ineffective for each subgroup of pupils, 
and Phi coefficients were calculated as a measure of consistency in 
effectiveness for the two subgroups in each cross tabulation. Phi 
coefficients, together with an indication of the significance of the 
associated Chi-square statistics, are given in the right-hand panel 
of Table 5. 

Inspecting the overall pattern of correlations and Phi-coefficients, 
a number of trends are apparent and worthy of mention. The degree of 
consistency in school effectiveness apoears to depend upon the 
similarity in family background of the pupils for whom school 
effectiveness has been determined- The Phi coefficients for black 
children are highest near the diagonal of the matrix, and decrease 
as one moves away from the diagonal. Kish correlations near the 
diagonal show consistency in school effectiveness for pupils with 
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similar family backgrounds (adjacent categories) , and low correlations 
located away from the diagonal indicate a lack of consistency in 
performance for pupils with dissimilar family backgrounds • This 
pattern of correlations and Phi coefficients is also obtained when 
children of each race are compared for similar and dissiailar home 
backgrounds; these values are found at the bottoa of Table 4. For 
example, schools that are effective for the poorest black children 
also tend to be effective for the poorest white children * «21, p < .01) 
but do not tend to be unusually effective or ineffective in teaching 
middle class children ( i » .02). There is a 

departure from this pattern in one case: when the performance of 
white children furnishes the basis for a school's classification, 
the schools appreared consistently effective (to varying degrees), 
regardless of fanily background, and the degree of consistency 
appears to be greatest for middle-class children (i.e., those 
having 7-8 or 9 home iterts). 

In summary, there is evidence that schools are consistently 
effective or ineffective beyond a level which would be expected on 
a chance basis, and that a school nay not be effective for both poor 
and middle-class children. 

Question Two ; How Large are the Differences between Effective and 
Ineffective Schools? 

In order to judce the importance of differences in pupil 
achievement associated with attending effective or ineffective schools, 
one would ideally like to know the effect of the given difference in 
achievement on future educ3:icnal or occupational opncrtunities . For 
example, if certain levels of sV-ill were necessary for educational or 
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Table 6 

Descriotive Statistics and Estircitcd Proportions (S) of Pupila 
Scoring 25 or Hirher within Effective and Ineffective Schools 
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occupat±onal advancement, one could calculate the difference in 
proportions of students fron effective or ineffective schools who are 
attaining the level of skill necessary for entry into an occupation, 
and use this ay an index of the inportance of differences in school 
effectiveness. While we havf* no information about the validity of 
using the EEOS verbal achievement test in this way, we have attempted 
to estimate the number of pupils in effective and ineffective schools 
who could successfully neet an arbitrary competency criterion: 
correctly completing half of the test items (i.e., 25 out of 50 items). 
These estimates provide another description of the range of performance 
differences between effective and ineffective schools. 

Since the data were obtained from an intermediate summary data 
file containing mean verbal scores and base n's for subgroups of 
pupils, we could not directly count the number of pupils belonging to 
a given subgroup who scored above 25. In order to estimate this 
number, an estimate of the within-school variation in verbal 
achievement was obtained by multiplying the standard deviation of school 
means by the square root of the average number of pupils on the basis 
of which the school means were calculated ( £ y - sjc S ) . Then, • 
assuming a normal distribution of scores within a school, the proportion 
of scores meeting the competency criterion was estimated. The means 
and standard deviations^ for effective and ineffective schools 

identified for each criterion subgroup of pupils are given in Table 6, 
along with the estimated proportions of pupils completinr at least 
25 of the 50 test items. (Also see Figure 1). On average, 75" of 
well-to-do students in ef receive schools show mastery of rnore than 
half the test iteras, while 7 2fi of poor students in effective schools 
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Figure 1. Estimated' proportion (p) of pupils 

scoring above 2 5 on the verbal test for subejroups 
of sixth crrade students. 
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show similar mastery. Thi3 finding pemits the general observation 
that, when a competency criterion is used in judging performance, 
effective schools can be shovn to all but eliminate the relationship 
between family background and pupil performance, at least in the 
acquisition of the tested school skills to the critical level of 
competency. Note further chat, on average, 51Z of well-to-do students 
in ineffective schools still shov mastery of more than half the 
items, while only 23% of poor students in ineffective schools show 
such mastery. That is 5 of course, a sizeable difference and has the 
effect of making pupil performance a dramatic function of family 
background • 

A second way to gauge the magnitude o£ the difference between 
effective and ineffective schools is to convert the mean score for 
each set of schools into a grade equivalent, an<? then calculate the 
difference in grade equivalents between the two sets of schools. This 
difference, expressed in vears , tells how far apart two samples of * 
children drawn from the norming sample would have to be in order to 
find a similar difference in mean scores. In this conversion, the 
normative standard deviation of 6.2 cas used, which represents 18 
months in terms of grade equivalents (cf. Jencks, 1972, p. 12, 
footnote 25). The differences in grade equivalents for effective 
and ineffective schools are, for black pupils in each of the four 
home-item categories, 4.9 years, 3.7 years, 3.9 years, and 3.9 years. 
The corresponding values for white pupils are 6 years, 4.7 years, 
3.1 years, and 2.5 years. The achievement advantage of effective 
over ineffective schools is greatest for poor children ani smallest 
for niddle-cla.ss children. : : .-svever. : : ie differences are larqe, even 
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for middle-class children, representing at minimum two and a half 
yearjir. 



Question Three : Is School Effectiveness Attributable Co Peer Social 
Class? 

The next question we wish to ask of the data is the one first posed 
by Coleman et al. (1966) and asked repeatedly by others (cf. Mayeske 
et al., 1972, 1973).. Is the effectiveness of a school primarily 

attributable to the social class of the pupils who attend the school? 
We approached the question in a way which is different from that of 
previous investigators. By stratifying the pupil population 
according to race and hone background and conducting our analyses 
separately tor each of the resulting eight subgroups of pupils, we 
could explore the relations of peer social class and school variables 
to achievement in school without having to first "remove" pupil 
family background bv a prior regression analysis . We could thus 
separate the effect of a pupil's family background from the effect 
of the social background of a pupil's peers in school. When using 
this approach, "social class characteristics" refer to the predominant 
familv background of pupils in the school and not to the background of 
the individual pupil whose achievement forM the basis for evaluating 
school effectiveness. Note chat it is entirely oossible that the 
effects of peer social class cay differ for the various subclasses of 
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puoiis we have been considering. 

Eight separate regression analyses were carried out, one for 
each of the subclasses of pupils who differ in race and nuaber of 
home itens. The regression analyses vere carried out using a stepwise 
regression procedure, entering the school social class variables ahead 
of other school descriptors. The stepping procedure provides a 
measure of the variance in achievenent accounted for at each stage 
in the stepping sequence, so that a nsasure of the variance accounted 
for by the first seven variables — the social class variables— could 
be obtained. This measure, or it3 square root, the multiple correlation 
coefficient, provided an initial answer to our question about the 
contribution of social class variables in accounting for school 
achievement.^ If the multiple correlation obtained using the seven 
social background variables as regressors is large in comparison to 
the multiple correlation obtained after all the other school variables 
have been added to the regression analysis, then it is possible to - 
conclude that the u nique contribution of school characteristics in 
fostering pupil achievement is minimal. On the other hand, if social 
background accounts for little of the variance in achievement, then 
our attention can shift to identifying the characteristics of schools* 
that are accociated with hieh pupil achievement. The results are shown 
in Table 7 and plotted in Figure 2. The seven social class variables 
entered we (1) percent of blac": pupils, (2) average family sire, 
(3) percent intact f .i-iilies , CO S (5) percent of fathers who are 
white collar workers for blac!; (^) and white (5) puoiis, (o) mean 
mother's education, and (7) -ear. father's education. For poor black 
pupils, the v.irinnco in school achievement associated with these 
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I: " Table 7 

£:■ Multiple Correlations Obtained in the ne^ression Analyses 



Criterion Group 


Mult. R. j 
vAll variables; 


Mult P.. 

VoOCloJL L» J.cLo5 /cLT. J • 


; Ratio of | 
i « 1 


Black nuoils with 0-4 hone items . 


.56 


.14 


.06 


Black pupils with 5-6 home items 


.58 


.32 


.30 


Black pupils with 7-3 home items 


t 




.37 


1 Black ounils with 9 hone items 


.57 


.39 1 


.47 


\ White puoils with 0-4 home items 


.58 ' 


.38 


.43 


\ Shite puoils with 5-6 home items 


! .54 
1 

: .72 


.33 


.37 


f White pupils with 7-3 home items 


.62 


.74 


\ White pupils with 9 homo items 


! .70 

1 

t 


.63 


.81 



.8 
.7 
.6 
.5 
.4 
3 

.2 
.1 



All 

Variable s 



Q - - 



Eh - " 



- 

O 




O Black 



_L 



_L 



□ White 

! L 



0- 4 5-6 7-8 9 

Number of Home Items 



Fiqurc 2. Multiple correlations (R) obtained in predicting 

mean verbal achieverent from social class variables alone, 
and from social class variables together with school variables 
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variables is only 6% of the total "explained" variance. For 
middle-class white pupils, a much larger proportion (81%) of the 
total explained variance is related to social class, and the degree 
of involvement of social class variables is in general greater for 
white pupils than for black pupils, and greater for middle class 
pupils than for poor pupils. 

Another way of examining the relationship between peer social 
class and school achievement is to look individually at the 
correlations between each of the social class variables and achievement 
for each of the eight criterion subgroups of pupils; these data are 
shown in Table 8 (to increase readability, correlations have been 
multiplied by 100 to eliminate the decimal point). In all cases, 
the correlations for poor black pupils are approximately zero. The 
correlations are greater for white pupils than for black pupils, and 
higher for middle-class pupils than for lower-class pupils. 

A third set of d?c;a also support these conclusions, and they are 
the differences between means for each of the social class variables, 
for schools that have been classified as effective or ineffective** 
The differences between the means for the effective and ineffective 
schools are given in Table 9 for each of the eight criterion subgroups 
of pupils; the variables are, once again, the seven social-class 
variables, the decree to which ceer social c**«»«» r*»i*f«*< 
school effectiveness depends upon the family bacKground of the 
pupil upon whose performance the school is evaluated. Schools in 
our samole that are effective for middle-class and white pupils tend 
to enroll a greater orooorrion of such children than do the less 
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Table 3 

Correlations between Social Class Variables and Achievement 
for the Eipht Criterion Croups of Pupils 2 







Black 


Pupils 


.1 


White 


Pupils 




Variable 




0-4 


5-6 


7-8 


9 


o-4 


5-6 


7-3 


9 


Z Black 




* -6 


-8 


-19 


-27 


-30 


-29 


-31 


-41 


Mean Family Size 




-2 


-9 


-15 


-21 


-26 


-21 


-37 


-35 


% FaTdlies Intact 




8 


24 


24 


37 


33 


25 


kS 


45 


% Wh. Collar rath. 


(Black) 


-7 


-9 


19 


17 


-2 


3 


'5 


7 


JS.Mi. Collar Path. 


(White) 


7 


11 


20 


19 


18 


18 


47 


52 


Mean t'other 's Education 


4 


21 


23 


22 


16 


20 


41 


46 


Hean Father's Education 


2 


17 


30 


33 


27 


22 


50 


5T 



« Correlations have been multiplied by 100 
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Table 9 
Differences between I-fcans 
for- Effective aid 



of Social Class Variables 
Ineffective Schools 





Blacl: 


Pupils 




White Puoils 




Variable 


CM 


5-6 


7-8 


9 


0-/| 5-6 7-B 


9 


% Black 


-2.1 


-5-5 


-18.3 


-26. H 


-13.1 -16.7 -25.0 


-17.3 


Mean Family Size 


.00 


-.13 


-39 


-.52 


-.40 -.12 -.65 


-.60 


% Families Intact 


1.6 


10.2 


11.9 


15.1 


13-6 9.3 17.1 


16.9 


% VJh. Collar Fath. (Black) 


-5.0 


-3.0 


9.1 


10.9 


-.5 1.0 3.9 


5.7 


% Uh. Collar Fath. ('.-.hite) 


1.9 


5.3 


12.1 


11.8 


7.7 10.0 23.5 


32.3 


Tfean Mother's Education 


-.03 


.22 


.36 


.35 


.18 .35 .75 


.33 


Mean Father's Education 

. 


-.03 


.17 


.19 


.60 


.36 .39 1.03 


1.19 
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effective schools. However, the schools that are effective in 
teaching poor black children turn out to be equivalent to the 
ineffective schools in terms of the social class variables. This 
finding demonstrates that school characteristics can be important 
in fostering high pupil achieveaent. On the basis of these results, 
we feel we must take issue with Coleman's conclusion that 

"the resources cost important for a child's achieveaent in 
school are the cognitive skills in his social environment in 
school, including his fellow-students as well as his teachers, 
and that these effects are strongest for the children with 
least educational resources outside school. . .Other resources 
on which school systems spend much money, appear unimportant; 
and lower-class students do better in absolute terms 
rather than worse... in schools where their relative 
achievement is low due to the presence of higher-performing 
middle-class students. M (Coleman, 1970, p. 245) 
The conclusion that poor children perform better in schools which 
contain high proportions of middle-class children is not supported 
by our analysis of the EEOS data. When one looks separately at the 
data which are relevant to this question— namely , at the social class 
characteristics of schools that are effective or ineffective in 
teaching poor black pupils, it becomes clear that these two groups of 
schools are indistinguishable on the basis of the social-class variables 
we have examined. 

Question Four : What are the Characteri s tics of Effectiv e Schools? 

Out" purpose is to describe those variables for which there are EEOS 
data thct distinguish effective fron ineffective schools. ~ he 
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stratification of the pupil population into eight subgroups varying 

in race and home background enables us to Judge the separate 

contribution of a given variable to school effectiveness for each of 

the eight subgroups. Four types of relationships are possible: (1) 

Variables nay be consistently related to school effectiveness in 

every pupil subsroup; (2) some variables nay show clear trends » so- 

that the nature of the relationship depends upon the family 

background and/or race of the pupils upon whose performance the 

schools are being evaluated; (3) some variables may be unrelated 

to pupil subgroup; and (4) some variables nay be inconsistently 

related to school effectiveness, with no clear trend. Variables 

in the first class will be called consistent predictors , and 

variables in the second class will be called social-class-dependen r 

predictors . Variables which are inconsistently related or unrelated 

to school effectiveness will not be discussed here. As we examine 

each school characteristic, we shall indicate the degree and nature. 

of its relationship to school effectiveness. We shall present the 

correlations with mean verbal achievement of black and white pupils 

in parenthesis, listed in each case for the subgroups of pupils having 

8 

0-4, 5-6, 7-8, or 9 home items, and in that order. 

We have elected to report results whenever consistent patterns 
of correlations have been found. Ve will not report here results 
bearing on school location, although there were significant differences 
in the location of effective and ineffective schools. Thesa data 
are discussed in an earlier report (Frederlksen, 1975). While the 
number of schools involved in the calculation of these correlations 
varies, correlations of .09 are senerallv significant at the .05 level* 
and correlations of .11 are generally significant at the .01 level. 



1. Teacher Attitudes and C haracteristics 

Teacher characteristics like age and sex were not consistently 
related to pupil performance. Those teacher variables that did turn 
out to be related to pupil performance are predictive of verbal 
achievement for middle class pupils, but not for poor black pupils 
and to only a moderate degree for poor white pupils. These variables 
include the teacher's race (black keyed positive) (black: -.01, -.13, 
-.15, -.24; white: -.28, -.34, -.5?, -.42), the teacher's verbal 
ability (black: 1,5,11, 11; white: 18, 15, 25, 23), the teacher's 
attitudes on race and social class, preferring to teach upper 
class children (black: 6, 12, 10, 16; white: 14, 3, 21, 24), middle 
class children (black: 6, 12, 9, 9; white: 14, 3, 22, 23), and white 
children (black: 6, 13, 23, 20; white: 31, 28, /.5, 40), and holding a negative 
attitude towards bussing (black: -6, -14, -8, -9; whiter -20, -23, 
-21, -13). The findings suggest that there is higher achievement 
among white and/or middle class children when they attend schools wtiose 
teachers are white and have middle-class backgrounds, and who prefer 
teaching children who have backgrounds similar to their own. However, 
the reverse statement does not appear to be true; achievement of poor 
children — particularly poor black children— is not related to the race 
or social class of the teachers working in a school, or to the stated 
social class preferences of their teachers. The verbal ability of a 
teacher is not related to the verbal achievement of poor black children, 
although it is associated with high achievement for white children and 
to a lesser extent for r.icidle-class black children. 

58 
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The schools in our sample that are effective in teaching poor 
children tend to have teachers who have been assigned to their school, 
while the less effective schools have teachers who have chosen to 
work in their school. The correlations of verbal achievement with 
the variable — teacher asked for school — are, for black pupils: 
-11, 4, 8, 14 and for white pupils: -10, 6, 4, 4. One other variable related to 
school effectiveness, but only for poor children, is a teacher's 
attitude toward compensatory education (black: -12, -6, -6, -8; 
white: -16, -12, -6, -2). Teachers in the more effective schools do 
not agree that "culturally disadvantaged" children benefit from programs 
of compensatory education, but hold conversely that a common standard 
of instruction can be applied to all. When we turn to another set of 
variables related to school programs, we shall find additional evidence 
to support the conclusion that schools that are effectively teaching 
poor pupils do not separate them according to "ability". 
2 . School Characteristics and Curriculum 
Consistent Predictors 

In the F.EOS questionnaire, the principals of the more effective 
schools responded that their students are not separated into ability • 
groups (black: -12, -2, -8,-6; white: -8,-7,-9, -5), and the 
teachers' responses confirmed this statement by saying that they teach 
puoils of varied abilities (black: -13, -12, -12, -12: white: -21, -13, 
-25, -18) . The more effective schools have few teachers of remedial 
reading (black: -8, -15, -4, -7; white: -14, -10, -23, -15), and few 
students are enrolled in special mathematics (black: -2, -9, -13, -6: 
white: -10, -14, -17, -12) cv -njjjsh course s (black: -7, -15, -19, 
-13; white: -16, -20, -28, -1 >. T'.iey also have fewer guidance /-Jj 
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counsellors (black: -14, -11, -4, -6; white: -16, -11, -IS/, -11) than 
do the less effective schools. However, they do have special education 
programs (black: 11, 17, 8, 3; white: 8, 18, 13, 11) • Thus, v<th 
regard to one of the most fundamental characteristics of an elementary 
school curriculua, there is a clear relationship between school 
effectiveness and nixing students of varying abilities and backgrounds. 

These measures, which are indicators of policy toward tracking, all show 
a negative correlation with verbal achievement, and the degree of 

correlation with school effectiveness appears to be independent of 

the social class of pupils for whom a school has been found to be 

effective. Such schools, however, do have special education programs * 

for pupils with certifiable disabilities, and, again, this relationship 

is independent of pupil social class. 

There is some evidence that schools that are instructionally 
most effective tend to have sniall classes (black: -5, -6, -4, -10; 
white: -3, -14, -15, -14), and use the National Teachers Examinations 
in selecting teachers (black: 9, 6, 7, 9; white: 14, 14, 26, 18). 
They also have a larger proportion of families who attend PTA meetings 
than the ineffective schools (black: 8, 13,20, 17; white: 16, 15, 
24, 25), and the principals of core effective schools generally 
believe their schools to have a good reputation among educators in 
their community (black: 7, 8, 7, 15; white: 3, 11, 15, 17). 

Pupils in schools classified as effective are more likely to have 
attended kindergarten (black: 12, 14, 13, 6: white: 23, 8, 17, 11) 
and nursery school (black: £, 15, 17, 13: white: 7, 6, 24, 32) than 
are pupils in less effective schools, 'ote that these effects of 
early education are armorer.: even :hou :h puoil f.'r.ilv background has 
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been controlled through stratification of the pupil population, 
and they show up even in the case (i.e., black children having" 
only 0-4 home items) where the effective schools have turned out 
to be matched with the ineffective schools on social-class 
variables* 

3. Affluence of the School 

Two measures which can be regarded as indicating the degree 
of affluence of a school district are related to school effective- 
ness, but only for middle-class children. High achievement for 
this group is found in schools with a large number of land acres 
(black: -6, 4, 9, 18; white: 1, 4, 15, 19), and relatively new 
school buildings (black: 7, 1, -9, -17; white: 6, -7, -17, -17). 

4. Some Additional Measures of the Outcome of School Experiences 

There are a number of additional variables that represent 
alternative measures of the effects of school experiences on the 
attitudes and behavior of pupils, although in the case of middle- 
class schools, these measures may also reflect a student 1 s home 
environment. For each of these variables there are consistent 
correlations with pupil achievement regardless of the social class 
background of the pupils, although in some cases the correlations 
tend to be higher for middle-class pupils than for poor pupils. 
Children who attend schools thac are instructionally effective 
attend school more regularly (black: 3, 4, 16, 16; white: 17, 13, 
23 9 19) , expect to continue their schooling for a longer period of 
time (black: 22, 25, 27, 24; white: 24, 21, 39, 41) than pupils 
who attend schools that are less effective, and their attitude 
toward chances in life is generally mere oositive (black: -S, -25, 
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-21, -32; white: -19; -21, -44, -39). Moreover, there is low 
racial tension in the nore effective schools (black: 16, 7, 11, 13; 
white: 14, 13, 18, 25) and a lover incidence of serious stealing 
within these schools (black: 6, 6, 16, 19; white: 13, 13, 24, 20). 



poor black children do not differ in the race or social background 
of their pupils, the correlation of .16 between incidence of racial 
tension and school effectiveness cannot be due to differences in 
racial composition of the two groups of schools. This suggests 
that effective school programs night contribute to improving race 
relations within schools, as well as to developing nore positive 
attitudes towards learning and education. 

Regression Analyses 

In our discussion of the association between school character- 
istics and instructional effectiveness, we have focused on the 
correlations between oredictors and the performance criterion. 
Regression analyses have been used only to estimate the overall 
degree to which variance in the criterion is generally related to 
the social class characteristics of schools, or uniquely related to 
institutional variables other than social class. Interpretation 
of regression weights is re?arded as extremely hazardous, due to 
their inherent instability from saaple to saaple. The problem 
can be illustrated using the results ve obtained for the social 
class variable Mean Mo ther y s Education , shown in Table 10. The 
trends that ate evident f^r the first cvo statistics are absent 
when one looks .i: rv. :rossion weights, or partial, correlations . 
For example, if rerird th* results for closely si-nilar pupil 



Note that, since effective and ineffective schools tfhich enroll 
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•Table 10 

Repression Statistics for the Variable r >*n "other's 
Educa tion Which were Obtained Tor Each Criterion Grouo 
of Pupils. 





Black Pupils 




V'nite Pupi 


.Is 




Statistic 


0-4 


5-6 


7-3 


9 


0-4 


5-6 


7-3 


9 


Correlation with criterion 


.0/1 


•21 


.23 


.22 


.16 


.20 


M 


.45 


Differences between nsans 
(Effective - Ineffective) 


-.03 


.22 


.36 


-35 


.13 


-35 


.75 


.33 


Standard Re«^ression 
Coefficient (beta) 


.01 


.13 


-.04 


-.on 


-.02 


-09 


.Oil 


-.05 


Partial Correlation 


.00 


.10 


-.03 


-.03 


-.02 


-.05 


.04 


-.03 - 



subgroups (e.g., black pupils with 5-6 hone itenis and black pupils 
with 7-8 hone items) as providing a crossvalidation of the regression 
weights, we find that the first two descriptive statistics have 
sitailar values in the two cases (compare .21 with .23, and »22 
with .36), while the corresponding regression weights are markedly 
dissimilar (.13 and -.04). The instability in regression weights 
in crossvalidation as illustrated using this variable is character- 
istic of nearly every variable included in our analyses of the EEOS 
This being so, there will be no further discussion of regression 
coefficients. Those who seek detailed description of our regression 
analysis may do so by referring to Frederiksen's 1975 report. 

Discriminant Analvs is 

We have already referred to the comparisons among means for 
effective and ineffective schools in our discussion of characteristics 
of effective schools. As we stated previously, schools were 
classified as effective for purposes of the discriminant analysis 
if above the 75th percentile in nean verbal achievement for the 
designated subgroup of pupils, and ineffective if below the 25th 
percentile for that subgroup of pupils. The school means for social 
class and school variables were calculated for the effective and 
ineffective schools , for each subclass of pupils. 

A discriminant function analysis was then conducted for each of 
the eight pupil subgroups. In these analyses, equations (functions) 
were develoDed for classifying schools as effective or ineffective 
on the basis of the social class and school variables. Simple 
F-tests (F=t* > ) of the di f f erer.ces between re3ns :*«.c multivariate 



-46- 

F tests based on the discriminant function analyses were then 
obtained for each variable. Results are presented in tabular 
forn in a previous report (Frederiksen, 1965). 

In general, differences between means of social class and 
school variables for effective and ineffective schools follow the 
patterns we have already observed in looking at the correlation 
between social class, school variables, and verbal achievement. 
For all pupil subgroups, there are highly significant (p < .001) 
differences between vectors of means for effective and ineffective 
schools (the statistic employed in the generalized Mahalanobis 
D-Square) . An index of the degree to which the two populations of 
schools are adequately characterized by the school variables 
employed is the percent of correct school classifications in using 
the discriminant function. The classification procedure involves 
calculating the discriminant scores for a given school and choosing 
the category (effective or ineffective) whose function has the 
larger value. The percent of schools correctly classified for the 
eight pupil subgroups were, respectively, 89%, 85%, 83%, and 82% for 
the four subgroups of black pupils differing in number of home items, 
and 85%, 82%, 91%, and 92% for the corresponding groups of white 
pupils. Our conclusion is that clear differences exist in the 
characteristics of effective and ineffective schools, and that it 
is possible to predict with a fairly high degree of precision the 
effectiveness of a school on the basis of observed characteristics 
of the school. A separate discussion of the nature of these 

characteristics will he or.i c ted, however , since such a discussion 
parallels to a l.irh derree the previous discussion of correlations 
of social class and school variables with pusil performance. 
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Overview and Conclusions 

A very great proportion of the American people believe that 
family background and heme envirennent are principal causes of 
the quality of pupil performance . In fact, no notion about 
schooling is more widely held than the belief that the family 
is somehow principal determinant cf whether or not a child 
will do well in school. The popularity of that belief continues 
partly because rany social scientists and opinion makers continue 
to espouse the belief that family background is chief cause of 
the quality of pupil performance . Such a belief has the effect 
of absolving educators of their professional responsibility to 
be lnstructlonally effective for all pupils. 

While the authors recognise the Importance of family background 
In developing a child's character, personality, arid intelligence, 
we cannot overemphasize cur rejection of the notion that a school Is 
relieved of its instructional oblic^tions when teaching the children 
of the poor. We reject such a notion partly because we recognize 
the existence of schools that successfully teach basic school skills 
to all children. Sucii success occurs partly because these schools 
are determined to serve all their pupils without recard to family 
background. At the sare tir.e, these schools recognize the necessity 
of modifying curricular design, text selection, teaching stratefjr, 
etc., in response to differences in family background arorjr; rupils 
in the school. Cur finiir.rs strorv-ly recorrsnd that all schools 
be held responsible Tor effectively Iczcrlrs' basic school siiills 
to all children. Curr.ir.-~ tc the less:r.s to re learr.^i from the 
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major studies of school effectiveness, our summary conclusions 
are as follows. 

1. Studies in which the Income and social class of pudIIs 
Is not included in the assessment shows prowth in pupil 
achievement to be significantly related to a variety 

of school and comunity characteristics (Shaycoft, 1957). 

2. In conventional regression analyses of school mean 
performance scores , the largest proportion of variance 
in performance is attributable to school variables that 
co-vary with rean pupil social class variables and thus 
cannot be regarded as independent effects of schools on 
pupil achievement (Mosteller and Moynihan, 1972, p. 19). 

3. The proportion of variation in performance which is 
uniquely associated with school variables grows as one 
restricts the population of schools considered to those 
which predominantly enroll the children of the poor 
(Mayeske et al.» 1972, p. 67). 

4. Inner-city schools can be located that differ in pupil . 
reading performance, even though the schools are ratched 

on pupil background (State of New York, Office of Education 
Perforrar.ee Review, 1974) . Thus, when attention is 
restricted to inner-city schools that enroll substantial 
nuntoers of cocr children, effective schools c.^n be 
identified that serve a pupil rooulacicn quite sirJLlar 
in far.il * tackrrour.-i to the rjril regulation of less 
effective schools . 
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In our re-analysis of the EEQS, separate evaluations of the 
schools were made for subgroups of pupils of different races and 
home backgrounds . Schools were found to be consistently effective 
(or ineffective) in .teaching subgroups of their populations that 
were homogeneous in race and economic condition. These schools 
were not found to be consistently effective in teaching children 
of differing economic condition and race. School effectiveness 
for a given level cn the hone items scale extended across racial 
lines. The prime factors which condition a school's instructional 
effectiveness appear to be principally economic and social, rather 
than principally racial. 

Without seeking to match effective and ineffective schools 
on mean social background variables, we found that the schools 
that were instructional ly effective for poor and black children 
were Indistinguishable fron the instruct ionally less effective 
schools on measures of pupil social background (mean father's 
and mother's education, category of occupation, percentage of white 
students, mean family size, and percentage of intact families). 
The large differences in performance between the effective and 
ineffective schools could not therefore be attributed to differences 
in the social class and family background of pupils enrolled 
in the schools. This finding, is in striking contrast to that of 
other analysts of the EE05, who have generally concluded that 
variability in performance levels frcr. school to school is only 
minimally related to inssi-uticnal characteristics . 
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Slnce our re-analysis used pupil performance as the basis . for 
assessing school effectiveness , we must entertain the possibility 
that effective schools enroll pupils of higher ability than pupils 
enrolled by Ineffective schools. Taken together, the following 
firdings strongly suggest that this is not true. (1) Schools 
classified as effective for one subgroup of pupils are also effective 
for a second, independent subgroup of pupils who have similar 
social backgrounds and whose performance has not been used in 
caking the original school classification . (2) In the case of 
poor black children, the effective and ineffective schools are 
comparable in demographic characteristics, including peer social 
class and school location, (3) The effective and ineffective 
schools differ, as noted earlier, In a number of characteristics 
related to programs, personnel, and methods of instruction. 

Given the character of our results and the relatively routine 
nature of the statistical technicues we employed, it is tempting 
to ask why earlier analyses of the EEOS do not appear to have 
correctly answered the question: What is the impact of school 
characteristics on the achievement of poor/minority students? 
The explanation for certain of the earlier errors of analysis may be 
found in the conventional methodology used in earlier studies 
of this question. A set of routine statistical assumptions were 
made in these earlier studies In the belief that those assumptions 
would not result in any seriously misleading conclusions. The 
crucial assumptions were: 

1. Homogeneity of Repression Equations . Repression surfaces 
were assumed to be hcrerenecus for subgroups of the pupil 
population. 
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2. Lack of Interactions between Pupil Background and School 
Effectiveness . Schools that are effective for pupils of 
one social class were assured to be effective for all 
classes of pupils. 
These assumptions are irplicit in the breakdown of the overall 

variance in ouoil achieverent into two orthogonal components: 

J? 

variance within schools fed variance between SAfeyjls, Part of 

the problem is that nationally only a small rfcr^&er* $f poor students are enrolled 

in most schools, so that their influence on QWtfsll school means 

and on the resulting regression equations is ssail* Moreover, 

the relation of school factors to educational a*;#&evsment is obscured 

by the removal of variance associated with social-class variables 

that had to be included in order to control for the family background 

of children within the school. What was needed was to concentrate 

the power of investigation and analysis on the target population 

of greatest interest to policy makers, namely, black and white 

children who are poor. Our way of doing this is to stratify the 

pupil population. When that is done, it is no longer necessary 

to conceive of school effectiveness as a unitary phenomenon. 

Schools can be found which are effective for one subgroup cf pupils 

but not for a second. Xbreover, usin=; our methods, it is no 

longer necessary to enter social background variables as a control 

for home- background. The separate effects of peer social background 

can be distinguished frcn the effects of home background of the "'j 

pupils whose achievement is the basis for judrinr school effectiveness. ."J 
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We recommend that future studies of school and teacher effectiveness 
consider the stratification design as a means for investigating 
the separate relationship of programs and policies for pupils 
of differing family and social background. Information about 
individual student family background and social class Is essential 
in our analysis if we are to disentangle the separate effects 
of pupil background and school social class make-up on pupil 
achievement. Moreover, studies of school effectiveness should be 
multivariate in character and errploy longitudinal records of pupil 
achievement in a variety of areas of school learning. The "Search 
for Effective Schools" project now underway at the Center for Urban 
Studies is designed in response to each of these deslgi suggestions. 

Finally, there may be many among you who do not think it 
proper to evaluate schooling on so narrow a basis as pupil acquisition 
of reading and math skills. We share your interest in broader 
purposes as proper ends for schooling, but hasten to point out 
the following. American city schools, as a group, do not now 
successfully teach reading and math to sufficient proportions 
of the children of the poor. To bring city schools to widespread 
instructional success would be a social service trlicrph of the 
first order. 

We are therefore quite content, at least for now, to concentrate 

our energies on the means by which schools that serve the poor 
micpt be brought to greater and .greater instructional success. 

i 
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FOOTNOTES 



The "Search for Effective Schools" project bepan In 1974 and 
has variously Included: Ron Edmonds , Harvard Graduate School of 
Education Center for Urban Studies, Project Director; Gary Ratner, 
Greater Boston Legal Services, Project Director of Legal Research; 
John Frederiksen, Bolt Beranek L N'evcxan, Inc., Project Director 
of Research; Larry Lezotte, Michigan State University Department 
of Urban and Metrooolitan Studies, Project Consultant and Researcher; 
Charle3 Cheng, University of California at Los Angeles Graduate School 
of Education, Project Research Associate. From its beginning, 
the project has been supported by the Carnegie Corporation, with 
Frederick Mosher serving as Project Program Officer* 

2 

Normative parade equivalents are obtained by dividing the difference 
In mean verbal scores by the overall normative standard deviation 
of 6.2, and nultiplyin? • by 13 nonths, the amount of verbal prowth 
reputed to correspond to a single standard deviation (cf- Jencks, 
1972, n. 25). 

3 

In our later analysis of characteristics of effective and 
ineffective schools, only schools with means below the twenty-fifth 
percentile will be termed ineffective. 

**Ti)e standard deviations are spuriously low, due to restriction 
of range. The estimate s 7 used in estimating s was based upon the 
entire sample of schools. 

5 Aside frcm our having stratified the pupil population before 
conducting the repression analyses, this procedure is similar 
to the one used by Coleman et ai. (1956) in their analysis of 
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^The percent of "explained" variance attributable to social 
class is the ratio of the squared nultiple correlation for social 
class variables alone to the squared mltiple correlation for 
the entire set of variables. 

7 Means and standard deviations for effective and ineffective 
schools are given In the previous report. 

8 

The correlations will be multiplied by 100 to increase 
their legibility. 
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